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(57) Abstract 

In a method of fair queue servicing 
at a queuing point in a multi-service class 
packet switched network, incoming packets 
are received in buffers and outgoing packets 
are scheduled by a weighted fair queue 
scheduler. Real-time information of buffer 
usage along with the minimum bandwidth 
requirement is used to dynamically modify 
the weights of the weighted fair queue 
scheduler. 




Rw.onnr.irv *wn an avatla i i ^ 



FOR THE PURPOSES OF INFORMATION ONLY 



Codes used to identify States party to the PCT on the front pages of pamphlets publishing international 
applications under the PCT. 



AM 


Armenia 


AT 


Austria 


AU 


Australia 


BB 


Barbados 


BE 


Belgium 


BF 


Burkina Faso 


BG 


Bulgaria 


BJ 


Benin 


BR 


Brazil 


BV 


Belarus 


CA 


Canada 


CF 


Centra] African Republic 


CG 


Congo 


CH 


Switzerland 


CI 


Cote d* I voire 


CM 


Cameroon 


CN 


China 


CS 


Czechoslovakia 


CZ 


Czech Republic 


DE 


Germany 


DK 


Denmark 


EE 


Estonia 


ES 


Spain 


FI 


Finland 


FR 


France 


GA 


Gabon 



GB 


United Kingdom 


GE 


Georgia 


GN 


Guinea 


GR 


Greece 


HU 


Hungary 


IE 


Ireland 


IT 


Italy 


JP 


Japan 


KE 


Kenya 


KG 


Kyrgystan 


KP 


Democratic People's Republic 




of Korea 


KR 


Republic of Korea 


KZ 


Kazakhstan 


LI 


Liechtenstein 


LK 


Sri Lanka 


LR 


Liberia 


LT 


Lithuania 


LU 


Luxembourg 


LV 


Latvia 


MC 


Monaco 


MD 


Republic of Moldova 


MG 


Madagascar 


ML 


Mali 


MN 


Mongolia 


MR 


Mauritania 



MW 


Malawi 


MX 


Mexico 


NE 


Niger 


NL 


Netherlands 


NO 


Norway 


NZ 


New Zealand 


PL 


Poland 


PT 


Portugal 


RO 


Romania 


RU 


Russian Federation 


SD 


Sudan 


SE 


Sweden 


SG 


Singapore 


SI 


Slovenia 


SK 


Slovakia 


SN 


Senegal 


sz 


Swaziland 


TD 


Chad 


TG 


Togo 


TJ 


Tajikistan 


TT 


Trinidad and Tobago 


UA 


Ukraine 


UG 


Uganda 


US 


United States of America 


vz 


Uzbekistan 


VN 


Viet Nam 



WO 97/14240 PCT/CA96/00681 



- 1 - 

Fair Queue Servicing using dynamic weights (DWFQ) 

This invention relates to the field of telecommunications, and more particularly to 
a method of fair queue servicing in asynchronous data networks, such as Asynchronous 
Transfer Mode (ATM) networks or more generally any packet switched network that 
supports more than one class of service. 

The use of ATM by a continually increasing number of applications is driving a 
requirement to increase the number of service classes and to allow more flexibility in the 
service offerings. To support the application requirements, the ATM Forum is adding 
new service categories in new releases of ATM specifications. Furthermore, network 
providers are looking for the flexibility of defining multiple service classes for a given 
service category. The service classes are differentiated by their Quality-Of-Service 
requirements (QoS). The QoS requirements are configurable in accordance with a bi- 
dimensional matrix describing loss and delay. The delay jitter is another factor which 
needs to be bounded for some service classes. 

Previously, three service categories were supported on an ATM network element, 
namely constant bit rate (CBR), variable bit rate (VBR) and unspecified bit rate (UBR). 
The CBR service is the only service that guarantees a bound on delay. It is used for time 
sensitive data, such as voice and video. 

These various services can be supported by traditional exhaustive round-robin 
queuing among two priority queues. However, this simple technique cannot be used 
when the number of queues increases beyond two, because of the high potential of 
starvation for lower priority queues. Furthermore, the exhaustive round robin can only 
guarantee bounds on delay and delay variation for the highest priority queue. The support 
of multiple service class in an ATM switching product or multiplexer requires a minimum 
of one queue per class. 

A queue scheduling algorithm. Weighted Fair Queuing (WFQ). has been recently 
proposed in the literature (see S. Golestani, A self-clocked Fair Queuing scheme for 
broadband applications. INFOCOM 1994. June 1994). 
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This scheduling scheme allows any number queues (service classes) to be 
serviced, while providing fair and work conserving access to bandwidth. One of the key 
features of WFQ is that the CDV (Cell Delay Variation) is bounded for any service class, 
as long as it is given a minimum weight. 

This proposed scheme can be implemented in ATM products. However, it has not 
been determined how to set the servicing weights efficiently to take into account the 
dynamically changing bandwidth requirement of each service class (connection 
addition/removal. ABR flow control, Early packet Discard). 

^ An object of the invention is to provide a framework that ensures that the weights 
are set appropriately to guarantee the desired Quality of Service and modified in real-time 
to ensure that the dynamic allocation of bandwidth across the classes is optimized. 

According to the present invention there is provided a method of fair queue 
servicing at a queuing point in a multi-service class packet switched network, wherein 
incoming packets are received in buffers and outgoing packets are scheduled by a 
weighted fair queue scheduler characterized in that real-time information of buffer usage 
along with the minimum bandwidth requirement is used to dynamically modify the 
weights of the weighted fair queue scheduler. 

Preferably the minimum bandwidth requirement is extracted during connection 
admission control. 

The method is particularly suitable for use in ATM networks. 

The DWFQ (Dynamic Weighted Fair Queuing) can be implemented at any 
queuing point which arbitrates servicing between n queues (n>?) 

The invention also provides a fair queue servicing arrangement in a multi-service 
class packet switched network, comprising a weighted fair queuing controller, and buffer 
means for receiving incoming packets in queues, characterized in that further comprises 
means for monitoring buffer usage for each queue, means for determining the bandwidth 
requirements of each class of service, and a service weights manager for dynamically 
modifying the weights of said weighted fair queuing controller means in response to said 
buffer usage and bandwidth requirements. 
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Preferably, the means for monitoring buffer usage a queue growth monitor which 
performs real-time estimation of the queue growth in said buffer means. 

The invention will now be described in more detail, by way of example only, with 
reference to the accompanying drawings, in which :- 

Figure 1 is a diagram depicting the high level queuing scheme at an ATM switch; 

Figure 2 shows the information provided by the Queue Growth Monitor; 

Figure 3 illustrates the data flow between the key components of the system and 
the action of the Service Weight Manager (SWM); and 

Figure 4 describes the process performed by the SWM. 

Referring now to Figure 1, ATM cells 2 arrive at buffer 1 and are placed in queues 
1 I 2 , ... l n From there the cells are passed to a weighted fair queuing unit 3. The buffer 1 
is also connected to a queue growth monitor 4, which in turn is connected to congestion 
control unit 5, congestion analyzer 6, and connection admission controller 8, which in 
turn is connected to-SVC & PVC (Switched Virtual Circuit and Permanent Virtual 
Circuit) connection handling unit 7, and service class manager 10. Queue growth monitor 
4. connection admission controller 8 and service class manager 9 are connected to service 
weights manager 9, which is connected to weighted fair queuing scheduler 3. 

^ The key element of the Dynamic Weighted Fair Queuing (DWFQ) scheme is the 
service weight manager (SWM) 9, which dynamically modifies the service weights to be 
used by the WFQ Scheduler 3. It uses real-time information from the service class 
manager 10, the connection admission controller 8, and the Queue growth monitor 4. 

The service class manager 10 configures the service classes. A service class is 
configured with a given value of delay (CTD - Cell Transfer Delay) and loss (CLR - Cell 
Ratio Loss) requirements. These parameters represent the maximum nodal delay and loss 
allowed in order to meet the end-to-end QoS requirements of the connection. The service 
classes are mapped into a priority table as exemplified in Table 1 . The priority table is 
used later by the service weight manager to allocate remaining bandwidth. The priority 
^able is updated when a service class definition is modified. The service class manager 
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also dictates which traffic descriptors are used to compute the minimum bandwidth 
required by a connection of a given class. 



CLR 


CTD 


100 ns 


500 us 


None 
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The connection admission controller (CAC) 8 computes the minimum bandwidth 
required for each service class. The minimum bandwidth is updated each time a 
connection of a given class is established or disconnected, based on its traffic descriptor. 

Table 2 shows a typical example of which traffic descriptors that can be used to 
compute the minimum bandwidth for each basic service category relative to the queue 
service rate (SR). The CAC 8 communicates the minimum Weight table to the S WM 
every time the value of the minimum weights have changed by a factor of 



Queuej 


Category 


min Wi 


Qi 


CBR 


(Z PCR) / SR 


Q2 


RT-VBR 


(Z SCR) / SR 


Q3 


NRT- 
VBR 


(I SCR) / SR 


Q4 


UBR 


0 



The CTD is further taken into account in the target queue size (TQS) table, which 
the maximum queue size allowed to limit the CTD. An example of TQS j computation 
shown in Table 3, for typical service categories. A zero TQS indicates that the queue 
grow without limitation. This table is computed by the CAC. 
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The Queue Growth Monitor (QGM) 4 performs real-time estimation of the queue 
growth every T s cell slots (sampling interval). The information provided by the Queue 
Growth monitor 4 to the SWM 9 consists of AQi, the Queue Growth Rate of output queue 
i during an, interval of duration Ts, Qi, the length of output queue i at the sampling time, 
and Ai, the arrival rate during the same interval of time. 

The corresponding parameters: queue size Qi, queue growth AQi, number of 
arrivals Ai are collected or each queue by the QGM 4 for each Ts interval. From these 
parameters, auxiliary parameters such as average arrival rate ki and service rate jii can be 
-derived by the SWM 9: 

X l : average arrival rate, X t = Ai + T s 

|ii : average service rate, & = Si - T s , where Si = Ai - AQi is the number of cells 
served during T s . 

Figure 2 shows the information provided by the Queue Growth Monitor 4. Using 
this information for the CAC 8, the service class manager 9 and the queue growth monitor 
4, the SWM computes the service eight for each queue / (W ; ) to be used during the next 
sampling interval. 

As can be seen in Figure 3, which shows the data flow between the key 
components of the system and the action of the SWM 9, the queue weights, Wi, are 
updated using information provided by the Queue Growth monitor 4. 

If Xj denotes the arrival rate of cells in queue / in the coming T s interval, then 
ideally, the target service rate can be calculated as: - T = Q. - TQS ; . This 
means at the end of next Ts interval, the queue size Qi will reach the target queue size 
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TQSi. On the assumption that X, remains unchanged from . the service weight 
w ■ = A. * T s can be approximated as 



However, the assumption on the stable arrival rate may not hold, and also the 
actual number of serviced cells Si could be less than Wi; therefore a more conservative 
approach is AQ, > 0, then Qj+AQ i; the predicted queue size at the end of the next Ts 
interval, is used to calculate the target service rate and weight. That is: 



w . = + Q ; + AQ - TQS, = A, + Q, + AQ ; - TQS, 

The detailed algorithm performed by the service weights manager 9 is shown in 
Figure 4. The queue size Qj at the end of each interval T s , the number of arrivals Aj during 
the previous interval T s , and the change in queue size AQj are input at step 20. Step 21 



conservatively adjusted to bring the queue size to TQSi at step 22; if no, the service 
weight W, is adjusted to bring the queue size to TQSi at step 23. The difference AW is 
determined in step 24. 

Step 25 determines whether the shared weights pool is empty: if yes, Wi is set to 
minWi in step 26; if no, step 27 determines whether Ws > AWj.- if yes, step 28 sets W; = 
min_Wj + AWi and W s = W s + AW,; if no, step 29 sets W f = min_W ; + W s and W s = 0. 

Step 30 runs through all the W< in the ordered list L and step 3 1 updates the weight 
table used by the Weighted Fair Queuing scheduler 3. 

The described technique complies with ITU and ATM Forum standards and can 
be applied to any switching equipment which supports more than a single service class of 



W . = £ • T s s X, • T s + Q. - TQS, = A, + Q ; - TQS, . 




determines whether the queue growth is positive: if yes, the service weight Wj is 



service. 
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Claims: 

1 . A method of fair queue servicing at a queuing point in a multi-service class packet 
switched network, wherein incoming packets are received in buffers and outgoing packets 
are scheduled by a weighted fair queue scheduler characterized in that real-time 
information of buffer usage along with the minimum bandwidth requirement is used to 
dynamically modify the weights of the weighted fair queue scheduler. 

2. A method as claimed in claim 1 , the minimum bandwidth requirement is extracted 
during connection admission control. 

3. A method as claimed in claim 1 , characterized in that said weights are also 
modified in accordance with real-time service class information. 

4. A method as claimed in claim 1, characterized in that buffer usage is monitored by 
a queue growth monitor, which performs real-time estimation of the queue growth every 
sampling interval T s . 

5. A method as claimed in any of claims 1 to 4, wherein said packet switched 
network is an ATM network and said packets are ATM cells. 
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6. A method as claimed in any of claims 1 to 5, wherein the weights of the weighted 
fair queue scheduler are modified in accordance with the following algorithm: 



From the Queue growth monitor: 
Qi : queue size at the end of Ts 
Ai : number of arrivals during previous Ts 
iSQi: change of queue size during previous Ts 



Weights Re-calculations per Ts 




Conservatively adjust service weight to 
bring queue size to TOSi. 
Wi s max {(Ai + Qi i&Qi - TQSi), min_Wi) 



Adjust service weight to bring queue 
size to TQSi. 

Wi = max {(Ai + Qi - TQSi). minJ/Vi) 



Weights Enforcements 



Yes 



Wi = mm Wi 




Wi = min_W» + Ws 
Ws =~0 



No 




Wi = min_Wi +^yvi 
Ws = Ws jyvi 



Bo through all the Wi 
jn the ordered list L ? 



I 



Yes 



Update weight table to be used by WFQ in the next Ts 
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7. A fair queue servicing arrangement in a multi -service class packet switched 
network, comprising a weighted fair queuing controller, and buffer means for receiving 
incoming packets in queues, characterized in that further comprises means for monitoring 
buffer usage for each queue, means for determining the bandwidth requirements of each 
class of service, and a service weights manager for dynamically modifying the weights of 
said weighted fair queuing controller means in response to said buffer usage and 
bandwidth requirements. 

8. A fair queue servicing arrangement as claimed in claim 7, characterized in that it 
further comprises a service class manager which stores the cell transfer delay cell loss 
ratio requirements for each class of service, and said service weights manager is also 
responsive to said class of service requirements stored in said service class manager to 
dynamically modifythe weights of said weighted fair queuing controller means. 

9. A fair queue servicing arrangement as claimed in claim 8, characterized in that 
said means for monitoring buffer usage comprises a queue growth monitor which 
performs real-time estimation of the queue growth in said buffer means. 

1 0. A fair queue servicing arrangement as claimed in claim 8, characterized in that 
said queue growth monitor outputs to said service weights manager the queue growth rate 
of each output queue i during a sampling interval, the length of the output queue / at 
sampling time, and the arrival rate of cells A* during the sampling interval. 

11. A fair queue servicing arrangement as claimed in any of claims 8 to 1 0, 
characterized in that said network is an ATM network. 
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Ts: Sampling interval 

Wi: service weight. Number of cells to be served in T's for output queue i. 



From CAC and the service class manager. 

min_ Wi: minimum service weight table 

TQSi: Target Queue Size table 

L: Queue Service Priority List (Sorted) 



Sorted 
List L 



Priority 
Order 



Q 1 



Q 2 



Q n 



Reserved Weight: 
I min Wi 



Shared Weight Pool 
WS = Ts-Imin W 



From the Queue Growth monitor (every Ts): 

Qi: queue size at the end of Ts. 
Ai: number of arrivals during previous Ts 
AQi: change of queue size during previous Ts 



SWM updates All Queue Weights after one Ts: 
(see Figure 4 for detailed algorithm 

(1) Queue growth rate AQil 

arrival rate Ai fAWi 
queue size Qi J 

(2) Wi = min_ Wi, guarantees minimum weight, 
provides protection for high priority queues 

(3) Further allocate the A Wi to Wi in the priority 
order, specified by list L: 

Wi = wi+AWi, if Shared Weight Pool isn't empty. 
Wi = min_Wi, otherwise (Ws = o). 
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From the Queue Growth monitor : 
Qi: queue size at the end of Ts. 
Ai: number of arrivals during previous Ts 
Qi: change of queue size during previous Ts 



Weights Re- calculations per Ts 
YES 



22 




r 



20 



Conservatively adjust service weight to 

bring queue size to TQSi. 
Vi = max {( Ai + Qi + Qi -TQSi, min_ Wi 
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Adjust service to bring queue 
size to TQSi. 

Wi = max {( Ai + Qi - TQSi, min 



AWi=Wi-min Wi 



Weights Enforcements 
YES 
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= min 




1 




Wi = min Wi + Ws 
Ws + O 



NO 



FIG. 4 




Wi = min.Wi +AWi 
Ws = Ws-AWi 
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Update weight table to be used by WFQ in the next Ts 
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